Uniqueness of the weights for minimal feedforward nets with a given input-output map

نویسنده

  • Héctor J. Sussmann
چکیده

|{ We show that, for feedforward nets with a single hidden layer, a single output node, and a \transfer function" Tanhs, the net is uniquely determined by its input-output map, up to an obvious nite group of symmetries (permutations of the hidden nodes, and changing the sign of all the weights associated to a particular hidden node), provided that the net is irreducible, i.e. that there does not exist an inner node that makes a zero contribution to the output, and there is no pair of hidden nodes that could be collapsed to a single node without altering the input-output map. The author thanks Eduardo Sontag for suggesting the problem and for his helpful comments and ideas, and an anonymous referee for suggesting how to improve the exposition at several points.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Uniqueness of Weights for Recurrent Nets

We will consider the parameter identifiability problem, which asks about the possibility of recovering the entries of the matrices A, B, and C from the input/output map u(·) 7→ y(·) of the system. This question has been already addressed in [1] and in [2] (and, for feedforward nets, in [6] and in [4]) where it is proved that, under appropriate minimality assumptions, the zero-initial state i/o ...

متن کامل

Minimizing the Weights dispersion in Cross-Efficiency Measurement in data envelopment analysis

  Because of the piecewise linear nature of the data envelopment analysis (DEA) frontier, the optimal multipliers of the DEA models may not be unique. Choosing weights from alternative optimal solutions of dual multiplier models is one of the most frequently studied subjects in the context of DEA. In this paper, the authors have been inspired by the idea of Cooper et al. (2011) to propose a li...

متن کامل

Existence and uniqueness results for neural network approximations

Some approximation theoretic questions concerning a certain class of neural networks are considered. The networks considered are single input, single output, single hidden layer, feedforward neural networks with continuous sigmoidal activation functions, no input weights but with hidden layer thresholds and output layer weights. Specifically, questions of existence and uniqueness of best approx...

متن کامل

Remarks on Interpolation and Recognition Using Neural Nets

We consider different types of single-hidden-Iayer feedforward nets: with or without direct input to output connections, and using either threshold or sigmoidal activation functions. The main results show that direct connections in threshold nets double the recognition but not the interpolation power, while using sigmoids rather than thresholds allows (at least) doubling both. Various results a...

متن کامل

Numerical solution of fuzzy linear Fredholm integro-differential equation by \fuzzy neural network

In this paper, a novel hybrid method based on learning algorithmof fuzzy neural network and Newton-Cotesmethods with positive coefficient for the solution of linear Fredholm integro-differential equation of the second kindwith fuzzy initial value is presented. Here neural network isconsidered as a part of large field called neural computing orsoft computing. We propose alearning algorithm from ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Neural Networks

دوره 5  شماره 

صفحات  -

تاریخ انتشار 1992